Archive
Tag: AI Benchmark
Ai2 Releases Molmo 2, an Open Video Model That Outperforms Qwen 3, GPT-5, and Gemini 2.5 Pro While Knowing Where the Action Happens
Ai2 has unveiled Molmo 2, the latest iteration of its open-source vision-language model (VLM). Arriving over a year after the original, this state-of-the-art update brings the most notable upgrades yet: support for multiple images and video, and grounding. The next-generation Molmo can now count and track objects or actions within videos. And just like its […]
Ai2’s Asta Launches as an Open Framework to Bring Rigor to Scientific AI
Fresh off unveiling MolmoAct and securing a U.S. government contract to build a new, fully open suite of advanced models, Ai2 is testing the boundaries of scientific discovery with the introduction of Asta, its new AI toolkit for scientific research. True to The Allen Institute for AI’s mission, this collection is built to give researchers […]
Ai2’s SciArena Benchmarks AI for Science, Inspired by ChatBot Arena
Nonprofit AI lab Ai2 has launched a new platform to help researchers evaluate which AI models perform best on scientific literature tasks. Called SciArena, it’s an open, collaborative service that enables head-to-head comparisons of large language models. Think ChatBot Arena—but built for the scientific research community. “Measuring progress in using AI agents for literature-grounded scientific […]
Ai2’s RewardBench 2 Is a Tougher Benchmark for Testing How Well AI Models Reflect Human Judgment
Ai2 has released an update to its RewardBench benchmark, making it more capable of evaluating reward models. The next-generation test is built using new, more complex examples to assess how accurately AI models can produce answers that are as accurate as those of a human. In its first round of testing, RewardBench 2 ranks Google’s […]
You.com Launches ARI Enterprise, an AI Research Agent for Financial Analysts and Consultants
In February, the enterprise AI platform You.com introduced its Advanced Research and Insights (ARI) agent, designed to perform deep research and act as a personal AI consultant. Now, just three months later, the company is rolling out ARI Enterprise, a new version designed specifically for consultants, financial analysts, and researchers. And according to You.com, it […]