Llama 3.2 1B
meta-llama
A lightweight 1-billion parameter language model optimized for efficient inference on resource-constrained devices and edge deployment, ideal for developers and organizations seeking to run conversational AI locally without requiring expensive hardware while maintaining a 131K token context window for handling longer documents and conversations.
- Context window
- 131,072 tokens
- Input cost
- —
- Output cost
- —
- Latency (p50)
- 258 ms
