by Tencent

Tencent: Hy4 preview.

text open weights datacenter 780B params 1M ctx
Cheapest input
$0.834/M
on DeepInfra
Cheapest output
$2.501/M
on DeepInfra
Smallest GPU
4× AMD MI300X
$2.00/hr
Description

About Tencent: Hy4 preview.

Hy4 preview is an open-weights mixture-of-experts model from Tencent's Hy team, with 770B total parameters and 49B active per token, under Apache 2.0. Its context length is 1M tokens, and an extra layer supports speculative decoding. Tencent built its training data around software engineering, office and analysis work, game development and scientific research. It calls this an early version, with known issues such as reasoning longer than needed and over-verifying its own work.

Context window

How much it can remember.

1M tokens ≈ 786,432 English words
4K 32K 128K 1M
Capabilities

What it can do.

· Vision input
· Audio input
· Video input
· Function calling
· Tool use
· JSON mode
✓ Streaming
· Fine-tuning