OpenAI has unveiled Jalapeño, its first custom-built AI inference chip, developed in partnership with Broadcom, reducing dependence on third-party chipmakers.
With AI systems becoming more advanced and attracting more users, demand for specialised hardware built specifically for AI workloads is increasing.
OpenAI is not alone in this transition as Meta also advanced its own in-house silicon ambitions through its Meta Training and Inference Accelerator (MTIA) programme.
Why OpenAI Built the Jalapeño Chip
Like Meta’s MTIA chips, Jalapeño is designed primarily for AI inference rather than model training.
Inference is the stage where an AI model processes requests and generates responses. Every time someone asks ChatGPT a question, an inference system is at work behind the scenes.
Because these requests happen continuously, running AI services at scale requires enormous computing power, making inference one of the industry’s biggest operating expenses.
Traditional processors such as CPUs and GPUs, particularly those supplied by Nvidia, AMD and Intel, are powerful enough to handle these workloads, but they are designed for a wide range of computing tasks. That flexibility comes at a cost, both financially and in terms of energy consumption.
Inference chips take a different approach. They are purpose-built to run AI models more efficiently, reducing power consumption, lowering operating costs and delivering faster responses under heavy workloads.
By developing specialised hardware, companies such as OpenAI can optimise performance while reducing reliance on external chip suppliers.
Will Chips Like Jalapeño Come to Smartphones?
Not anytime soon.
Cloud-scale inference processors are fundamentally different from the chips found in consumer electronics. They are designed for data centres, consume hundreds of watts of power and require sophisticated cooling systems to operate efficiently.
Smartphones and laptops already include their own AI accelerators in the form of Neural Processing Units (NPUs). These processors handle tasks such as facial recognition, voice processing, image enhancement and on-device AI features, including text generation.
However, NPUs are not replacements for CPUs or GPUs. Instead, they work alongside them, with each processor handling the tasks it is best suited for.
In flagship smartphones released in 2026, such as the Galaxy S26 series, NPUs are integrated into the same System-on-Chip (SoC) as the CPU and GPU, enabling faster and more efficient on-device AI without relying entirely on cloud processing.
What it Means for the AI Industry
The rise of inference chips is unlikely to solve the industry’s growing memory demands. AI models continue to require vast amounts of memory in data centres, while consumer devices also need more memory as manufacturers add increasingly sophisticated AI features.
As a result, demand for higher-capacity memory is expected to remain strong, keeping pressure on component costs.
Even so, dedicated inference processors are expected to play a key role in the future of AI-powered services. From autonomous logistics and predictive manufacturing to robotics and large-scale AI assistants, they promise faster performance, lower operating costs and improved energy efficiency.
Most consumers will never see or interact directly with chips like Jalapeño. But they are likely to benefit from the faster, cheaper and more responsive AI services these processors are designed to power.
