-
Beyond LLM-as-a-Judge: Deterministic Metrics for Multilingual Generative Text Evaluation
Paper • 2604.05083 • Published -
QCRI/OmniScore-mxbai
Feature Extraction • 0.3B • Updated • 16 -
QCRI/OmniScore-deberta-v3
Feature Extraction • 0.2B • Updated • 30 • 1 -
QCRI/OmniScore-Data
Viewer • Updated • 581k • 58 • 1
AI & ML interests
None defined yet.
Recent Activity
Papers
Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models
Fanar-Sadiq: A Multi-Agent Architecture for Grounded Islamic QA
Organization Card
Qatar Computing Research Institute (QCRI), part of Hamad Bin Khalifa University, conducts applied and foundational research in computing to address national, regional, and global challenges. Our work spans Arabic language technologies, multilingual NLP, speech and conversational AI, social computing, data analytics, cybersecurity, and responsible AI. Here we host QCRI’s open models, datasets, and benchmarks to support reproducible research and advance AI technologies for Arabic, low-resource languages, and culturally grounded applications.
-
Beyond LLM-as-a-Judge: Deterministic Metrics for Multilingual Generative Text Evaluation
Paper • 2604.05083 • Published -
QCRI/OmniScore-mxbai
Feature Extraction • 0.3B • Updated • 16 -
QCRI/OmniScore-deberta-v3
Feature Extraction • 0.2B • Updated • 30 • 1 -
QCRI/OmniScore-Data
Viewer • Updated • 581k • 58 • 1
A comprehensive Arabic-centric multimodal generative AI stack with specialized models for text, image and poetry generation and image understanding
models 38
QCRI/MemeLens-VLM
Image-Text-to-Text • 9B • Updated • 180 • 2
QCRI/LlamaLens
Text Generation • 8B • Updated • 21 • 2
QCRI/OmniScore-mxbai
Feature Extraction • 0.3B • Updated • 16
QCRI/distillHarness
Updated
QCRI/OmniScore-deberta-v3
Feature Extraction • 0.2B • Updated • 30 • 1
QCRI/Fanar-2-Oryx-IG
Text-to-Image • Updated • 13 • 2
QCRI/Fanar-2-Oryx-IVU
Image-Text-to-Text • 8B • Updated • 489 • 4
QCRI/Fanar-2-Diwan
Text Generation • Updated • 12 • 2
QCRI/Fanar-2-27B-Instruct
Text Generation • 27B • Updated • 9.3k • 12
QCRI/MemeIntel
Image-Text-to-Text • 11B • Updated • 11
datasets 61
QCRI/AynVQA-ArabicNLP26
Viewer • Updated • 16k • 1.79k • 2
QCRI/ArGuard-Task1
Viewer • Updated • 4.5k • 782
QCRI/PropXplain
Viewer • Updated • 27.1k • 52
QCRI/MemeReason
Viewer • Updated • 16.8k • 223
QCRI/Fanar-Sadiq-Bench
Viewer • Updated • 2.42k • 35
QCRI/ArabicCulturalQA
Viewer • Updated • 53.8k • 73 • 2
QCRI/M2CQA-A
Updated • 14
QCRI/MMCQA-SemEval27
Viewer • Updated • 60 • 111 • 2
QCRI/M2CQA
Viewer • Updated • 36.5k • 281 • 1
QCRI/BloomBench
Viewer • Updated • 8.01k • 72