Evaluation datasets maintained by EleutherAI
AI & ML interests
Large language models, scaling laws, AI Alignment, democratization of DL
Recent Activity
View all activity
Papers
Soohak: A Mathematician-Curated Benchmark for Evaluating Research-level Math Capabilities of LLMs
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
Organization Card
Welcome to EleutherAI's HuggingFace page. We are a non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence. Our open source models are hosted here on HuggingFace.
You may also be interested in our GitHub, website, or Discord server.
This collection contains the model and data artifacts from O'Brien et al. (2025). https://deepignorance.ai
-
Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs
Paper • 2508.06601 • Published • 7 -
EleutherAI/deep-ignorance-unfiltered
Text Generation • 7B • Updated • 188 • 6 -
EleutherAI/deep-ignorance-e2e-strong-filter
Text Generation • 7B • Updated • 1.09k • 1 -
EleutherAI/deep-ignorance-strong-filter-pt-weak-filter-anneal
Text Generation • 7B • Updated • 39 • 1
Evaluation datasets maintained by EleutherAI
This collection contains the model and data artifacts from O'Brien et al. (2025). https://deepignorance.ai
-
Deep Ignorance: Filtering Pretraining Data Builds Tamper-Resistant Safeguards into Open-Weight LLMs
Paper • 2508.06601 • Published • 7 -
EleutherAI/deep-ignorance-unfiltered
Text Generation • 7B • Updated • 188 • 6 -
EleutherAI/deep-ignorance-e2e-strong-filter
Text Generation • 7B • Updated • 1.09k • 1 -
EleutherAI/deep-ignorance-strong-filter-pt-weak-filter-anneal
Text Generation • 7B • Updated • 39 • 1
models 973
EleutherAI/gpt2-custom
Text Generation • 0.1B • Updated • 249
EleutherAI/bergson-smollm2-lds-4k
Updated
EleutherAI/bergson-smollm2-scratch-olmo-16k
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x
Updated
EleutherAI/sae-SmolLM2-1.7B-layer17-32x-embedskip
Updated
EleutherAI/bergson-smollm2-lds-32k
Updated
EleutherAI/bergson-smollm2-lds-8k
Updated
EleutherAI/bergson-smollm2-lds-16k
Updated
EleutherAI/gpt-2-wikitext-chunks-epsroot-0-bs64
0.1B • Updated • 8
EleutherAI/gpt-2-wikitext-chunks-epsroot-1e-6-bs64
0.1B • Updated • 11
datasets 260
EleutherAI/metasmoothness-bank-plan_muon_eps1e17_16k_bs128
Viewer • Updated • 2k
EleutherAI/metasmoothness-bank-plan_adam_eps1e17_16k_bs64
Viewer • Updated • 2k
EleutherAI/metasmoothness-bank-plan_adam_eps1e17_4k_bs256
Viewer • Updated • 2k
EleutherAI/bergson-smollm2-scaling
Viewer • Updated • 512k • 46
EleutherAI/bergson-wikitext-2-4656-chunks
Viewer • Updated • 5.14k • 131
EleutherAI/bergson-smollm2-lds-chunks
Viewer • Updated • 60.1k • 88
EleutherAI/gpt2-wikitext-stdadam-trackstar-scores
Updated • 42 • 1
EleutherAI/bergson-wikitext-512-chunks
Viewer • Updated • 4.86k • 624
EleutherAI/bergson-recall-9000
Viewer • Updated • 360k • 29
EleutherAI/bergson-magic-scores-gpt-2
Viewer • Updated • 100 • 58