On September 1, Tencent Hunyuan's team rolled out the Hy4 preview lightweight model. The model's weights have undergone a substantial compression, shrinking from a hefty 1.5TB to a mere approximately 214GB. According to the team, when it comes to long-text comprehension, the compressed model is virtually indistinguishable from its original counterpart. Its multi-round long-context retrieval prowess also remains largely unscathed, staying close to the original level, though there is a minor dip in mathematical capabilities. Nevertheless, its overall performance still comfortably falls within an acceptable range. This model boasts support for a wide array of functions, encompassing daily coding support, tool invocation, long document handling, and general question-answering.
