Newshot

Own, don’t rent: Why agentic AI is pulling cloud computing back on-prem

Summary

Agentic AI is reviving an argument over renting versus owning compute, and the model plane — the layer that decides where AI models run — sits at the center of it. Open-source efforts such as Upbound Inc.’s Modelplane route inference across clouds, but many enterprises want the models on hardware they control. That shift favors […] The post Own, don’t rent: Why agentic AI is pulling cloud computing back on-prem appeared first on SiliconANGLE .

Original text(via SiliconANGLE)

Agentic AI is reviving an argument over renting versus owning compute, and the model plane — the layer that decides where AI models run — sits at the center of it. Open-source efforts such as Upbound Inc.’s Modelplane route inference across clouds, but many enterprises want the models on hardware they control.

That shift favors companies that built early for on-premises cloud infrastructure. Oxide Computer Co., which raised $445 million in October to expand rack production, built its business on the idea that enterprises at scale will want to own their computers, according to Bryan Cantrill (pictured), co-founder and chief technology officer at Oxide.

“Cloud computing is great, but the model shouldn’t be exclusively to rent it. You get to a certain scale, as it turns out, you want to own your own computer,” Cantrill said.

Cantrill spoke with theCUBE Research’s John Furrier at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed renting versus owning compute, why agentic workloads are moving on-prem and multi-tenancy for isolating those workloads.

Agentic workloads move on-prem

Agentic workloads are driving an explosion in compute demand, and much of it is CPU-heavy work that enterprises would rather own than rent. Economics remains the main reason to bring it in-house, but where models live is a close second, Cantrill explained. That makes the model plane as much a data governance decision as an infrastructure one.

“There is a real enterprise drive towards open-weight models, and I think you’re going to see more and more of that as people want to run the models on-prem and allow their data to not actually leave,” Cantrill said.

Security is the other half. Oxide stripped the UEFI BIOS and baseboard management controller out of its rack to shrink the attack surface, and built public cloud-grade multi-tenancy in from the start. Those early design choices give enterprises a perimeter for isolating agentic workloads, according to Cantrill.

“I think multi-tenancy means you’ve got potentially adversarial tenants that are going to be on the same resource,” Cantrill said. “They’re going to be sharing the same computer, sharing the same network, and they need to do that … without violating the confidentiality, without breaching one another.”

The same racks can take on legacy virtualization workloads from customers unhappy with pricing changes at Broadcom Inc.’s VMware business. That lets enterprises run old and new applications on one general-purpose platform, Cantrill noted.

“You want all that flexibility that you get from elastic compute, but you need it for economic reasons, security reasons, latency reasons,” Cantrill said of the case for on-premises cloud computing. “You need it in your own data center. You want to control your fate.”

Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of SC26:

(* Disclosure: NYSE Wired sponsored this segment of theCUBE. Neither NYSE Wired nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)

A message from John Furrier, co-founder of SiliconANGLE:

Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.

  • 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
  • 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network

Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/

Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.

The text above was extracted automatically from the source page and may miss images, tables or code blocks. The original is authoritative.

Published by SiliconANGLE
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗