36 protein LMs: 3 archs x 4 scales x 3 seeds on UniRef50, compute-optimal. Transformers out-scale Mamba SSMs. Code: github.com/ygzdvr/nanoprot
Yagiz Devre
yagizdevre
AI & ML interests
None yet
Recent Activity
updated a collection about 15 hours ago
nanoprot v0.5 — protein LM scaling suite updated a collection about 15 hours ago
nanoprot v0.5 — protein LM scaling suite updated a collection about 15 hours ago
nanoprot v0.5 — protein LM scaling suiteOrganizations
models 15
yagizdevre/nanoprot-mamba-XS
Text Generation • Updated
yagizdevre/nanoprot-mamba-S
Text Generation • Updated
yagizdevre/nanoprot-mamba-M
Text Generation • Updated
yagizdevre/nanoprot-mamba-L
Text Generation • Updated
yagizdevre/nanoprot-gpt2-S
Text Generation • Updated
yagizdevre/nanoprot-gpt2-M
Text Generation • Updated
yagizdevre/nanoprot-gpt2-L
Text Generation • Updated
yagizdevre/nanoprot-esm2-XS
Fill-Mask • Updated
yagizdevre/nanoprot-esm2-S
Fill-Mask • Updated
yagizdevre/nanoprot-esm2-M
Fill-Mask • Updated
datasets 0
None public yet