Three ArXiv Papers Advance Language Model Capabilities Through Novel Training and Evaluation Methods

Three ArXiv Papers Advance Language Model Capabilities Through Novel Training and Evaluation Methods

Three research papers published on ArXiv on July 16, 2026, present advances in language model development, focusing on evaluation, behavioral analysis, and training improvements.

According to arxiv.org, researchers introduced M-JudgeBench, “a ten-dimensional capability-oriented benchmark designed to comprehensively assess the judgment abilities of MLLMs” (Multimodal Large Language Models). The paper notes that existing judge benchmarks “categorize samples by task types but fail to capture the fundamental judgment capabilities required for reliable evaluation.” The researchers also proposed Judge-MCTS, a data construction framework, and trained M-Judger, “a series of strong judge models” that demonstrated superiority on existing benchmarks.

In a second paper, researchers presented “the first systematic application of persona vectors at this scale, compiling a 53-trait inventory across four behaviorally distinct domains,” according to arxiv.org. The study labeled traits as “natural (expressed at baseline), steerable latent but amplifiable, or intractable (resistant to standard extraction).” The research found that “all nine agentic traits are natural” in the models tested.

A third paper, accepted at ICLR 2026, investigated representation-based exploration for language models. According to arxiv.org, the researchers found that “exploration with a simple, principled, representation-based bonus derived from the pre-trained language model’s hidden states significantly improves diversity and pass@k rates.” For Qwen-2.5-14b-Instruct, they reported “over 50% improvement in verifier efficiency on almost all tasks.”