togethercomputermodel

Meta Llama 3.1 8B Instruct Awq Int4

text instruct free long-context

Best for

Instruction FollowingGeneral ChatLong DocumentsBook Summarisation

Use this model Try in Playground Compare →Alternatives →

Context Window

131K tokens ≈ 291 pages of text

Input Cost

Free

Output Cost

—

Latency p50

256ms

Pricing Details

Standard Pricing

Input (per 1M tokens)

$0.00

Output (per 1M tokens)

$0.00

Run it locally

Local run command

# Refer to provider docs: https://www.together.xyz/docs

Presumptive Specs:

Typical GPU

12–24 GB VRAM

System RAM

16+ GB

Disk

20+ GB free

Runtime

Docker / local runtime

Reference links

www.together.xyz/docs

Hallucination Score™ (est.)

Community reliability estimate · not official

Generally reliable

About this score: Community-estimated based on user reports and publicly available benchmark data (e.g. TruthfulQA). This is not an official score from the model provider. Scores may be inaccurate — always verify with the official leaderboard before making production decisions.

Price HistoryPro

Input & output cost per 1M tokens over time

Price history is a Pro feature

Track pricing trends and catch price drops early.

Upgrade to Pro — $19/mo →

Provider

togethercomputer

Usage & Examples

Learn how to use Meta Llama 3.1 8B Instruct Awq Int4

✓Complex reasoning and analysis

✓Customer support automation

✓Content generation and editing

✓Code review and debugging

✓Research summarization

💡 Tip: Start with the sample prompts above to see how Meta Llama 3.1 8B Instruct Awq Int4 works best.

Community Prompts

Proven prompts shared by the community for this model

Loading prompts…