UPDATED 14:29 EST / NOVEMBER 19 2026
AI inference servers shrink to fit the air-cooled racks enterprises already run
by Ryan Stevens
Power-efficient inference chips are becoming the entry price for enterprises that want to run AI on hardware they own.
As AI shifts from building models to running them every day, costly graphics processing unit racks and the liquid cooling they demand keep many companies renting compute instead. That gap is opening room for challengers to the incumbent chipmakers. Axelera AI B.V. built its business at the edge with low-power chips and edge AI development tools, and it is now taking that technology into data center infrastructure, according to Manuel Botija (pictured), vice president and head of product at Axelera.
“Enterprises cannot own their own infrastructure. They’re locked out because of the cost and the power,” Botija said. “We are enabling them now to own it. It’s not that we are helping the world save power or save money — which we are — but it’s that we are unlocking use cases that were simply not possible before.”
Botija spoke with theCUBE Research’s John Furrier and Rebecca Knight at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how power-efficient inference chips are heading for the data center and how enterprises locked out by the cost and power of GPU racks can own their own AI infrastructure instead of renting compute. (* Disclosure below.)
Power-efficient inference chips head for the data center
Axelera’s Europa chip has been shipping since September. Ahead of SC26, the company unveiled Titania, a third-generation architecture that scales the design up to a 400-watt chip. The resulting six-kilowatt server is built to perform like leading data center GPUs while fitting into the existing 20- to 30-kilowatt air-cooled racks of an ordinary enterprise data center, Botija explained.
“Having a six-kilowatt server that can perform like a data centre DPU is a pretty big deal,” he said. “It basically means that they have some storage equipment, some networking equipment, some traditional CPU equipment, and next to all of that, they can also insert some AI inference hardware acceleration without needing to go and rebuild another server room or another data center.”
For enterprises that would rather own their AI hardware than pay a recurring cloud bill, the barriers have been steep. A GPU rack costs at least $1 million, often far more, and usually requires liquid cooling, Botija noted. Axelera’s answer rests on digital in-memory computing, a technique that grew out of its founders’ research and gives the company’s power-efficient inference chips a performance-per-watt advantage.
“Now you can own your own infrastructure,” Botija said. “You can amortize those investments and … reduce your OPEX, and therefore be more profitable as a company.”
Stay tuned for the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of SC26.
(* Disclosure: NYSE Wired sponsored this segment of theCUBE. Neither NYSE Wired nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
- What we learned from Nvidia's first earnings call without Jensen Huang
- D-Matrix bets stacked DRAM can solve inference's memory bandwidth problem
- Hitachi Vantara bets smarter storage can close AI's pilot-to-production gap
- China-based AI robotics biotech firm MegaRobo raises $200M to accelerate scientific discovery
- Agentic AI pushes the neocloud race beyond GPU counts toward global platforms
- AI's next build-out: Inference racks that resize themselves for every new model
- What we learned from Nvidia's first earnings call without Jensen HuangINFRA - BY ZEUS KERRAVALA . 27 MINUTES AGO
What we learned from Nvidia's first earnings call without Jensen Huang
INFRA - BY ZEUS KERRAVALA . 27 MINUTES AGO
- D-Matrix bets stacked DRAM can solve inference's memory bandwidth problemAI - BY KELLY KNIGHT . 38 MINUTES AGO
D-Matrix bets stacked DRAM can solve inference's memory bandwidth problem
AI - BY KELLY KNIGHT . 38 MINUTES AGO
- Hitachi Vantara bets smarter storage can close AI's pilot-to-production gapAI - BY KELLY KNIGHT . 1 HOUR AGO
Hitachi Vantara bets smarter storage can close AI's pilot-to-production gap
AI - BY KELLY KNIGHT . 1 HOUR AGO
- China-based AI robotics biotech firm MegaRobo raises $200M to accelerate scientific discoveryEMERGING TECH - BY KYT DOTSON . 3 HOURS AGO
China-based AI robotics biotech firm MegaRobo raises $200M to accelerate scientific discovery
EMERGING TECH - BY KYT DOTSON . 3 HOURS AGO
- Agentic AI pushes the neocloud race beyond GPU counts toward global platformsINFRA - BY RYAN STEVENS . 3 HOURS AGO
Agentic AI pushes the neocloud race beyond GPU counts toward global platforms
INFRA - BY RYAN STEVENS . 3 HOURS AGO
- AI's next build-out: Inference racks that resize themselves for every new modelINFRA - BY RYAN STEVENS . 4 HOURS AGO
AI's next build-out: Inference racks that resize themselves for every new model
INFRA - BY RYAN STEVENS . 4 HOURS AGO