M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 40 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 34 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 23 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 88 • 1
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 40 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 34 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 23 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 88 • 1
