Llama 3 70B Instruct Reference
Auto-regressive LLM with optimized transformers, SFT, and RLHF for alignment with helpfulness and safety preferences.
LLM
API Usage
How to use Llama 3 70B Instruct ReferenceModel CardPrompting Llama 3 70B Instruct ReferenceApplications & Use CasesAPI Usage
Endpoint
meta-llama/Llama-3-70b-chat-hf
RUN INFERENCE
curl -X POST "https://aitradestore.com/api/v1/chat/completions"
-H "Authorization: Bearer $AITRADESTORE_API_KEY"
-H "Content-Type: application/json"
-d '{
"model": "meta-llama/Llama-3-70b-chat-hf",
"messages": [{"role": "user", "content": "What are some fun things to do in New York?"}]
}' JSON RESPONSE
RUN INFERENCE
from aitradestore import AiTradeStore client = AiTradeStore()
response = client.chat.completions.create(
model="meta-llama/Llama-3-70b-chat-hf",
messages=[{"role": "user", "content": "What are some fun things to do in New York?"}], ) print(response.choices[0].message.content) JSON RESPONSE
RUN INFERENCE
import AiTradeStore from "ai-tradestore"; const aitradestore = new AiTradeStore(); const response = await aitradestore.chat.completions.create({
messages: [{"role": "user", "content": "What are some fun things to do in New York?"}],
model: "meta-llama/Llama-3-70b-chat-hf", });
console.log(response.choices[0].message.content) JSON RESPONSE
Model Provider:
Meta
Type:
Chat
Variant:
Parameters:
70B
Deployment:
✔ Serverless ✔ Dedicated
Quantization
FP16
Context length:
8K
Pricing:
$0.88
