AXI Framework: The Cure for the Cost Crisis in AI

AXI: The Cure for the Cost Crisis in AI

Authors/Creators

• Rajnish choubey, Architect (Other)

• Shalendra Gaur (Researcher)

Description

AXI is a host-side layer that holds the exact state of an AI job outside the chat, checks every reply with a deterministic gate before it is applied, and sends the model a short fresh prompt at every step. This paper reports pre-registered tests on Gemini 3.8 Flash, open models, an NVIDIA T4 and L4 and a Google TPU v6e: exact state on 1,500 of 1,500 steps, prompts 169 times smaller on average, one exact step 4.5 to 9.3 times cheaper, and up to 185 times more sessions per chip (memory headroom). Predictions were hash-locked before each run and every figure can be recomputed from the saved files. The architecture is by Rajnish Choubey; the tests were built and run by Shalendra Gaur. Code and tests: https://github.com/gaurshalendra2412/axi-runtime

Files

AXI_white_paper_v3.pdf

Files (537.0 kB)

Additional details

Related works