Newshot
Account

[X·模拟] 有人在 3090 上跑通了 70B 模型的量化推理

Summary

帖子给出了显存占用与吞吐实测数据,约为同尺寸模型的 1/3 成本。

This source only provides a headline — there is no body to show. Use “Read the original” below to read it at the source.

Published by X(模拟)
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗