Hy4 Preview Released: 770B-Parameter Open-Source Model with 1M Context

Tencent Hy ·

Key Info

Hy4 preview has been released, bringing a 770B-parameter model with 49B active parameters, a 1M context window, and an open-source, productivity-focused design at a consistent affordable price.

Highlights

  • Massive scale: 770B total parameters with 49B active, likely using a Mixture-of-Experts architecture.
  • 1M context window: Supports extremely long inputs for complex productivity tasks.
  • Open source frontier: Weights and resources are available on Hugging Face and GitHub.
  • Affordable and consistent pricing: Designed for practical, ongoing use.
Loading...