Pinned Loading

1. Video-MME Video-MME Public

   ✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

   787 30

2. Video-MME-v2 Video-MME-v2 Public

   Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understanding

   Python 369 3

3. MME-RealWorld MME-RealWorld Public

   ✨✨ [ICLR 2025] MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?

   Python 160 10

4. MME-CoT MME-CoT Public

   MME-CoT: Benchmarking Chain-of-Thought in LMMs for Reasoning Quality, Robustness, and Efficiency

   Python 136 7