Search
Meta's recently released Llama-4-Maverick has experienced a dramatic drop in rankings, sliding from second to 32nd on the LMArena leaderboard. This significant decline has sparked suspicion among developers, who are questioning whether there may have been rank manipulation involved. According to reports, the version submitted by Meta differs markedly from the publicly available open-source version, which has been officially designated as a "special edition." Notably, the corrected open-source version has also witnessed a sharp decline in rankings, performing worse than several other models.
In response, Meta has clarified that the special edition was specifically optimized for dialogue tasks. The company further stated that it intends to continue exploring customized versions in the future, while taking developer feedback seriously into consideration.
-
C114 Communication Network -
Communication Home
