TinyLlama Project.

1.1B Llama-architecture model trained on 3T tokens. Edge / embedded deployment target.

Models from TinyLlama Project.

TinyLlama 1.1B

1B

by TinyLlama Project · TinyLlama · 2,048 ctx

1.1B Llama-arch model — 3T training tokens.