Yao Shunyu and Hunyuan Team Answer Netizens on Reddit, Hy Small Model Already on Roadmap

They also revealed quite a few secrets behind the training
Tingyu, from Wofeisi, Quantum Bit | WeChat Official Account QbitAI
The Hy small model is already on the roadmap, and there are also plans for a model targeting 24GB of VRAM.
In the early hours of this morning, Yao Shunyu and the Tencent Hunyuan team came to the Reddit community and held an AMA around the newly released Hy4 and Hy4 flash.

AMA is short for "Ask Me Anything," meaning "if you have anything you want to ask, just ask." Netizens asked questions in the comments, and Hunyuan team members replied directly.

The participant list only shows Reddit accounts. As for which alias is Yao Shunyu, we haven't figured that out yet...
The protagonists of this AMA are the two models Hunyuan released in succession this month.
Hy4, released on November 4, is the flagship. It can understand text, images, and video, and is suitable for complex tasks such as long-horizon software engineering that require multi-step reasoning and repeated tool calls.
Hy4 flash, released on November 16, focuses on speed and cost for everyday office work. It supports text and image input and a context of up to 1 million tokens, with about 12 billion parameters activated per token.
Both Hy4 and Hy4 flash have been integrated into Tencent WorkBuddy. The Hunyuan team also incorporated typical tasks in WorkBuddy such as fixing spreadsheets, editing documents, and making PPTs into the internal benchmark WorkIndex. Based on this benchmark, the average per-task cost of Hy4 flash is about 1/20 that of the flagship Hy4.
The weights of both models have been made public. At the AMA, a netizen directly reported their computer specs: 96GB of VRAM and 128GB of RAM. Can it run Flash?
The team said it can run, with the main weights kept on the GPU, while some expert layers and the Engram lookup module can be moved to system memory.
Someone also asked about llama.cpp, and the team said adaptation is in progress.
When talking about R&D, the team also revealed quite a few secrets behind the training.
Can Flash's activated parameters be reduced further? They used the MoE sparsity experiments they had done to explain the trade-offs.
When letting the Agent solve problems on its own, what troubles did they encounter during training? Sometimes it would directly go online to find ready-made answers and skip the problem-solving process.
A netizen also asked what behavior was hardest to improve in post-training, and the team replied with just one word: Overthinking. The flagship Hy4's reasoning chain is sometimes too long. For Flash, the team first distilled from the flagship, then used reinforcement learning to shorten the reasoning chain.
From how the models are trained to whether developers can run them, this AMA covered quite a few issues that usually take only one line on a model card but are unavoidable in real use.
The following is an excerpt of the AMA Q&A, organized by theme, with the Chinese translation abridged.
Why does Hy4 "think too long," and how was Flash trained?
Netizen: Like Hy4 preview, the official Hy4 version sometimes reasons for too long. Is this related to the reward design of reinforcement learning, or to the distribution of the training data? Can the model learn when to stop?
Hunyuan team: Hy4's goal is to maximize intelligence, and the long reasoning chain is a problem we are aware of. We can distill Hy4 into the more cost-efficient Hy4 flash and use reinforcement learning on Flash to shorten the reasoning chain.

Netizen: In the post-training stage, which model behavior is the hardest to improve?

Netizen: How much room for improvement is left in Hy4's current parameter scale? To build stronger models in the future, must parameters keep increasing?
Hunyuan team: We believe Hy4 still has considerable room for improvement, especially in post-training. We are investing in large-scale reinforcement learning and continuing to improve user experience and model safety. At the same time, we plan to train larger-scale models.

Netizen: When training Hy4 and Hy4 flash for long-horizon Agent tasks, what is the hardest situation to handle in multi-turn reinforcement learning?
Hunyuan team: The trickiest part is flaws in the training environment design, where the model exploits loopholes to get rewards. For example, we have to prevent the Agent from directly searching online for ready-made answers and make it complete the task itself.
Netizen: When doing command-line tasks, if the model gets one parameter wrong, the command may fail. How do you improve the accuracy of tool calls, and how do you make the model remember earlier context in long tasks?
Hunyuan team: We added hard cases where models are prone to mistakes into the reinforcement learning data, and made the rewards more granular, with heavier penalties for errors in key details. For long tasks, we are continuously lengthening the context used in reinforcement learning training, and also improving the model's ability to compress context and retain key information.

Netizen: Yao Shunyu often mentions that choosing training data requires judgment. How do you judge whether a batch of data is good?
Hunyuan team: Data quality has many dimensions, and the requirements differ across domains and tasks. Whether using human experts or agents, designing and cleaning data takes a lot of effort. In the end, you still have to run experiments to see whether the data brings improvement.
Netizen: In the HyRA 2.0 experiment, where did the improvement brought by Hy4 mainly come from? Did it discover new improvements in architecture or data mixing ratios?
Hunyuan team: This improvement mainly came from low-level throughput optimization. To get models more involved in R&D, we still need to improve their ability to judge training plans. Using AI for AI R&D is itself a long-cycle endeavor with many difficulties.
Netizen: You have already used Hy4 and HyRA 2.0 to improve the training infrastructure and trained better small models. What experiments will you do next to see whether the models trained in this round can be better at R&D in the next round?
Hunyuan team: We are working on HyRA 3.0, stay tuned.
Netizen: If Hy4 were run on its own, could it now produce the next-generation model through recursive self-improvement? How do you evaluate this ability?
Hunyuan team: Our recursive self-improvement capability is still in an early stage, and we have built several internal benchmarks to evaluate the key capabilities involved.
Where do Flash's parameters go?
Netizen: Excluding Engram, the Hy4 flash backbone has about 156 billion parameters, with about 12 billion activated per token. If the total parameters stay the same and the activated parameters are reduced to 8 billion or 5 billion, how much would performance drop?
Hunyuan team: We have done scale experiments with different MoE sparsity levels. When the number of activated parameters is fixed, increasing sparsity improves computational efficiency. But if total parameters are fixed and activation is reduced to 8 billion or 5 billion, I expect model quality to drop noticeably. The number of activated parameters determines how much compute each token can use, and increasing sparsity can make up for part of it.
Netizen: Why does Hy4 flash allocate about 63.5 billion parameters to Engram? How was this ratio determined?
Hunyuan team: Our experiments showed a U-shaped curve. Counting Engram in the total parameter count, when Engram accounts for about one-third, it is close to the optimum in the experiments. If the ratio is lowered further, computational efficiency decreases.

Netizen: Why did Flash choose sliding window attention (SWA)?
Hunyuan team: Sliding window attention can compress the KV cache to about one quarter of its original size, significantly reducing deployment costs.
Small models, local deployment, and next steps
Netizen: Will there be a Hy4 mini? Some people also want a lighter version than Flash, for document parsing, classification, and simple automation.
Hunyuan team: The Hy small model is already on the roadmap.
Netizen: Will the next-generation Hy model reach 1.5 trillion to 2 trillion parameters?
Hunyuan team: The scale of the next-generation Hy model will certainly expand significantly further.
Netizen: Would you consider launching a lighter Flash-Lite? For example, for document parsing, classification, and simple automation.
Hunyuan team: Yes, stay tuned for Flash-Lite.
Netizen: Are there plans for a model targeting 24GB of VRAM?
Hunyuan team: Yes, it will be released in the future.
Netizen: I have 96GB of VRAM and 128GB of system memory. Can I run Hy4 flash?
Hunyuan team: Yes. The main weights and attention computation are kept on the GPU, some expert layers can be offloaded to system memory, and the Engram tables can also be placed in memory.
Netizen: For the same work task, the hosted version of Hy4 flash got everything right in my tests, but the local NVFP4 version had about an 8% error rate. Is this model harder to quantize?
Hunyuan team: Quantization quality depends heavily on the method and calibration. The team suggests trying the NVFP4 version quantized with GPTQ. In our evaluation, this version has a smaller gap from BF16 and is better suited to tasks sensitive to accuracy.
Netizen: How will llama.cpp support proceed? Will you cooperate with the inference framework community in advance?
Hunyuan team: We are working on llama.cpp adaptation and expect to release it to the community soon. We are also cooperating with communities such as vLLM and SGLang.
Netizen: Will the existing Hy4 flash continue to be updated?
Hunyuan team: Yes. We are optimizing the pre-training and post-training plans for Flash-class models.
How to view model performance
Netizen: Why weren't results on common benchmarks such as GPQA Diamond, τ-bench, IFBench, and SWE-bench published?
Hunyuan team: We showcased newer and harder benchmarks such as Agents' Last Exam and ProgramBench. The ones you mentioned appeared earlier, and scores are already close to saturation.
Netizen: I feel that some models' writing ability is regressing. Is it because too much code was used for training and it overfitted, or is there another reason?
Hunyuan team: We have noticed this too, and it may be related to the training objective. We want the model to write more like a human and with fewer clichés, and we are improving this.

Title: Yao Shunyu and the Hunyuan Team Answer Netizens on Reddit, Hy Small Model Already on the Roadmap
Body:
One More Thing
And with that, the QA transcript comes to an end.
Want to try Hy4 flash yourself? Open WorkBuddy, select Hy4 flash from the model list, and hand it the spreadsheet you've been meaning to fix or the meeting notes you've been meaning to organize.
Before November 30, you can try it free for a limited time on WorkBuddy~

Reference link: https://www.reddit.com/r/LocalLLaMA/comments/1y15w4a/tencent_hy_team_shunyu_yao_here_ask_us_anything/
- Embodied AI Goes Global, Logistics Leads the Way 2026-11-09
- miHoYo Published a VLA Paper 2026-11-21
- The Riemann Hypothesis Proved?! With Claude's Help, a 34-Year-Old Mathematician Releases a Lean Proof 2026-11-21
- Capital Is Retreating from "World Models" 2026-11-08
Related Reading

Tencent Hunyuan's Latest Image-to-Video Model! Point Anywhere You Want It to Move, So This Is What Zhuge Qing Looks Like with His Eyes Open | Open Source
Tencent Hunyuan launches it jointly with Tsinghua and HKUST

Tencent Adjusts Its Large Model Organizational Structure: Yao Shunyu Joins, Reports to President Liu Chiping
Yao Shunyu serves as Tencent's Chief AI Scientist

Training Time Halved, Performance Rises Instead of Falling! Tencent Hunyuan Open-Sources MixGRPO, an Efficient Reinforcement Scheme for Image Generation
A new training framework combining SDE and ODE sampling

An Open-Source Image Generation Framework Comparable to GPT-4o Is Here! Tencent Teams Up with InstantX to Solve the Character Consistency Challenge
Perfectly achieves personalized character creation while ensuring inference efficiency and text editability

Tencent Hunyuan Hy ASR 3.0 preview: Letting Speech Recognition Understand Context
